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1. 



(Amended) A method for browsing a multimedia data [using a multilevel object 



data structure,] comprising [the steps of): 

(1) receiving multimedia information and multiple supplementary information [on] 
including content information and real information on a program in the multimedia information 
of each object in the multimedia information [on the same time]; 

(2) separating the multimedia information and the multiple supplementary 

information; 

(3) displaying the multimedia information; and, 

(4) browsing/ searching supplementary information related to a particular object 
from the multiple supplementary information, and displaying the supplementary information 
when a user requests for browsing/searching the supplementary information related to the 
particular object. 

3. (Amended) A method as claimed in claim [2] 1, wherein the content information 
and the real information includes selective combinations of [information which represents 
relations ofj object information, event information, place information, and object/ event/place 
[information] in a graph. 
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5. (Amended) A method as claimed in claim 3, wherein the object information 
includes; 

text information having information describing the object, and 

an image [information on the object] illustrating the text information. 

8. (Amended) A multi-level object data structure in a system for displaying 
multimedia information, 

wherein the object data comprises multiple supplementary information on each object 
included in the multimedia information , wherein the [has] multiple supplementary information 
[structure including at least] further includes content information and real information on a 
particular program. 

9. (Amended) A multi-level object data structure as claimed in claim 8, wherein the 
content information and the real information includes selective combinations of semantic 
information which represents [relations of| object information, event information, place 
information, and semantic information representing relations of object/ event/ place information 
in a graph. 



1 1 . (Amended) A multi-level object data structure as claimed in claim 9, wherein the 
object information includes; 
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text information having information describing the object, and 

an image [information on the object] illustrating the text information. 



14. (Amended) A multi-level object data structure [wherein contents of a moving 
picture is expressed in a graph of object and place relation and an array of related events are 
made for each relation for making relation, and, for providing a function for displaying a 
required section, the] 

describing a moving picture [is expressed] in an object [structure] description 
scheme for providing information on [objects] an object appearing in the moving picture , a place 
[structure] description scheme for providing information on a place [which is a background of 
an event, an event structure for providing information] required for describing a particular unit 
of event in the moving picture, and [relations of the structures in a graph] a relation graph 
description scheme of the object/event/place, and . 

[for searching] describing the moving picture [by using] in a [double] dual structure [of] 
including content information and real information of the moving picture on at least one relation 
for each of the relations or a selected element[, in the moving picture]. 

15. (Amended) A multi-level object data structure as claimed in claim 14, wherein 
each of the object [structure] description scheme , the place [structure] description scheme , and 
the event [structure, expressed as] description scheme, including content information and real 
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information of the moving picture, are expressed in text information describing at least object 
name, place name, and event. 

1 7 . (Amended) A system for browsing a moving picture [by using a multi-level ob j ect 
data structure] comprising: 

means for supplying moving picture [digital] information including [a] multiple 
object information [structure] having content based meaningful object information of the 
moving picture and real [object] information of the object; 

means for receiving the [digital information and separating and reading the 
multiple object information and the] moving picture information; [and] 

means for presenting real object information included in the multiple object 
information [describes] in response to a users request. 

18. (Amended) A system as claimed in claim 17, 

wherein the multiple objectinformation [structure has multiple object information 
structures] are provided for each of the object, the place, and the event, [and] 

wherein the means for presenting real object information [presents] provides real 
information on an object cast in the moving picture or real place information on the place which 
is a background of an event. 
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REMARKS 



Claims 1 and 3-18 are currendy pending in the above-reference patent application. 
Claims 1, 3, 5, 8, 9, 11, 14, 15, 17, and 18 are amended by way of the present Amendment. 
Claim 2 is cancelled by way of the present Amendment. 

Claims 1-13 were rejected under 35 U.S.C. § 112, second paragraph for indefiniteness. 
Claims 1, 2, and 8 were rejected under 35 U.S.C. § 102(b) as being anticipated by Balogh et al. 
(U.S. Patent No. 5,493,677). Claims 3-7 and 9-13 were rejected under 35 U.S.C. § 103(a) as 
being unpatentable over Balogh et al. in view of Lagarde et al. (U.S. Patent No. 5,710,918). 

In response to the rejection of claims 1-7 under 35 U.S.C. § 112, second paragraph 
for indefiniteness, the Applicants respectfully request reconsideration. The Office Action 
states on page 2 that the preamble of independent claim 1 recites a "multilevel object data 
structure" and the body of this claim does not address this recited structure. Accordingly, for 
clarification, the Applicants have amended the preamble of claim 1 to recite "A method for 
browsing a multimedia data comprising:". 

In the Office Action on page 2, it is stated that the Applicants did not provide enough 
information explain the phrases "real information" and "content information" which are recited 
in claims 3-4. The Applicants respectfully disagree. Please see page 6, lines 3-6 of the 
specification, for one explanation of "real information" and "content information". 

In the Office Action of page 2, it is stated that there is insufficient antecedent basis for 
the Limitation "the character". The Applicants respectfully disagree. In line 3 of claim 4, 



Serial No. 09/594,808 Docket No. CIT/K-114 

"...describing character of..." is recited. In line 4 of claim 4, "character" is then referred to as 
"...the character..." 

On page 3 of the Office Action it is stated that the limitation of "image information on 
the object information" in claim 5 is not clear. For clarification, the Applicants have amended 
this recitation to recite "an image illustrating the text information". 

In response to the rejections of claims 8-13 under 35 U.S.C. § 112, second 
paragraph, the Applicants respectfully request reconsideration. It is stated in the Office 
Action on page 2 that the preamble of claim 8 recites "a multilevel object data structure" and 
does not fiarther limit this recitation in the body of the claim. For clarification, the Applicants 
have amended claim 8 to include the recitation of "...wherein the object data comprises..." 

On page 2 of the Office Action, it is stated that the phrases "real information" and 
"content information" are not defined in the specification. The Applicants respectfially disagree. 
Please see page 6, lines 3-6 of the specification for one explanation of these recitations. 

On page 2 of the Office Action, it is stated that the recitation of "the character" in claim 
10 lacks sufficient antecedent basis. The Applicant respectfiiUy disagree. In Une 3 of claim 10, 
"...describing character of..." is recited. In line 4 of claim 10, "character" is referred to as "the 
character". 

On page 3 of the Office Action, is it stated that the recitation of "image information on 
the object information" in claim 11 is not clearly described. Accordingly, for clarification, the 
Applicants have amended this recitation to recite "an image illustrating the text information." 
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In response to the rejection of claims 14-16 under 35 U.S.C. §112, second 
paragraph for indefitiiteness, the Applicants respectfully request reconsideration. The 

Office Action states on page 2 that the preamble of independent claim 14 recites "a multilevel 
object data structure" and the body of this claim does not address this recited structure. 
Accordingly, for clarification, the Applicants have amended claim 14 to recite "[a] multilevel 
object data structure describing a moving picture in an object description scheme..." 

In the Office Action on page 2, it is stated that the Applicants did not provide enough 
information to explain the phrases "real information" and "content information" which are 
recited in claims 14-16. The Applicants respectfully disagree. Please see page 6, lines 3-6 of the 
specification for one explanation of "real information" and "content information". 

In response to the rejection of claims 17 and 18 under 35 U.S.C, §112, second 
paragraph as being indefinite, the Applicants respectfully request reconsideration. The 
Office Action states on page 2 that the preamble of independent claim 17 recites "multilevel 
object data structure" and the body of this claim does not address this recited structure. 
Accordingly, for clarification, the recitation of "a multilevel object data structure" has been 
removed from this claim. 

The Applicants have also made various none-substantive amendments to the 
claims for the purposes of clarification. These amendments are not intended to narrow the 
scope of the claims and were not made in response to any rejections under 35 U.S.C. § 112, 
second paragraph. 
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In response to the rejection of claim 1 under 35 U.S.C. § 102(b) as being 
anticipated by Balogh et al., the Applicants respectfully request reconsideration. This 
claim recites receiving multimedia information and multiple supplementary information.. .of 
each object in the multimedia information...'* 

Balogh et al. relates to generation, archive, and retrieval of digital images with evoked 
suggestion-set captions and natural language interface. In column 1, lines 56-61 it is disclosed 
that images are achieved and received by associating metadata with an image. The metadata 
includes bibliographic data, a caption, and a set of suggestions evoked by the image. However, 
unlike the recitations of claim 1, there is no disclosure of "receiving multimedia information and 
multiple supplementary information of each object in the multimedia information". This evident 
and apparent, as the disclosure of Balogh et al. is merely related to associating captions with an 
entire image. However, the association of captions within an entire image does not anticipate 
"multiple supplementary information of each object in the multimedia information" as recited 
in claim 1. Particularly, the disclosure of metadata in Balogh et al. merely relates to a way of 
indexing images with words for a keyword search and not a hierarchy of information specific 
to identified attributes or objects. At least for these reasons, not all of the recitations of claim 
1 is not disclosed in the applied prior art reference of Balogh et al. Accordingly, a prima facie case 
of anticipation has not been established in the rejection of claim 1 under 35 U.S.C. § 102(b). 

In response to the rejection of claim 8 under 35 U.S.C. § 102(b) as being 
anticipated by Balogh et al., the Applicants respectfully request reconsideration. This 
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claim recites "supplementary information on each object included in the multimedia 
information." Balogh et al. has been discussed above. For similar reasons, as discussed above, 
Balogh et al. does not disclose "supplementary information on each object included in the 
multimedia information". Accordingly, a prima facie case of anticipation has not been established 
in this rejection. 

In response to the rejection of claims 3-7 under 35 U.S.C, § 103(a) as being 
unpatentable over Balogh et al. in view of Lagarde et al., the Applicants respectfully 
request reconsideration. These claims comprise the same recitations as claim 1, which was 
discussed above. As discussed above, the prior art reference of Balogh et al. does not disclose 
"...multiple supplemental information.. .of each objectin the multimedia information..." Further, 
the Applicants respectfully submit that Lagarde et al. does not alleviate this deficiency of Balogh 
et al. This evident and apparent as Lagarde et al. merely relates to a method for distributed task 
fulfillment of web browser requests. At least for these reasons, the prima facie case of 
obviousness has not been established in this rejection. 

In response to the rejection of claims 9-13 under 35 U.S.C. § 103(a) as being 
unpatentable over Balogh et al. in view of Lagarde et al., the Applicants respectfully 
request reconsideration. These claims comprise the same recitations as claim 8, which is 
discussed above. As discussed above, Balogh et al. does not disclose "supplementary 
information of each object included in the multimedia information." Lagarde et al. has been 
discussed above. For similar reasons, as discussed above, Lagarde et al. does not alleviate the 
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deficiencies of Balogh et al. At least for these reasons, a prima facie case of obviousness has not 
been established. 

In response to the rejection of claims 14-16 under 35 U.S.C. §103(a) over Balogh 
et al. in view of Lagarde et al., the Applicants respectfully request reconsideration. These 
claims recite describing a moving picture in an object description scheme for providing 
information on an object appearing in the moving picture. 

As discussed above, Balogh et al. relates to generation, archive, and retrieval of digital 
images with evoked suggestions-set captions and natural language interface. However, the 
disclosure of Balogh et al. is merely related to associating captions with an entire image. 
However, the association of captions with an entire image does not anticipate describing a 
moving picture in an object description for providing information on an object appearing in the 
moving picture. Further, Lagarde et al. does not alleviate this deficiency. At least for these 
reasons, a prima facie case of obviousness has not been established. 

In response to the rejection of claims 17 and 18 under 35 U.S.C. §103(a) as being 
unpatentable over Balogh et al. in view of Lagarde et al., the Applicants respectfully 
request reconsideration. These claims recite a means for supplying moving picture 
information including multiple object information having content based meaningful object 
information of the moving picture and real information of the object. Balogh et al. and Lagarde 
et al. have been discussed above. For similar reasons, as discussed above, neither Balogh et al. 
or Lagarde et al. disclose a means for supplying moving picture information including multiple 
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object information of a content based meaningful object information of the moving picture and 
real information of the object. At least for these reasons, a prima facie case of obviousness has 
not been established. 

CONCLUSION 

In view of the foregoing amendments and remarks, it is respectfully submitted that the 
application is in condition for allowance. If the Examiner believes that any additional changes 
would place the application in better condition for allowance, the Examiner is invited to contact 
the undersigned attorney, Daniel H. Sherr . at the telephone number listed below. 

To the extent necessary, a petition for an extension of time under 37 C.F.R. 1.136 is 

hereby made. Please charge any shortage in fees due in connection with the filing of this, 

concurrent and future replies, including extension of time fees, to Deposit Account 16-0607 and 

please credit any excess fees to such deposit account. 

Respectfully submitted, 
FLESHNER & KIM, LLP 

Daniel Y.J. I<im 
Registration No. 36,186 
Daniel H. Sherr 
Registration No. 46,425 

P.O. Box 221200 
ChantiUy,VA 20153-1200 

703 502-9440 DYK/DHS:lm.s:ylw 

Date: October 8, 2002 
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